Why Use 100 Layers When You Can Suffer With One